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(54) Method for adapting committed information rate over frame relay switched network 



(57) The present invention aims to improve the 
Committed Information Rate (CIR) functionality in order 
to turn it into an Adaptive Rate Base (ARB) mechanism, 
so as to apply it to frame relay networks or an internet 
server. The solirtion Is based on the interaction between 
a proactive setting of the Explicit Congestion Notifica- 
tions (ECN) in the Frame Handler (FH) function of the 
switches and a converging Adaptive CIR algorithm in 
the Terminal Equipments. 

The result of this interaction is that when a logical bottle- 

FRTE 



neck is in the process of settling in a switch, the CIR at 
the Terminating Equipment adapts itself to the through- 
put of the forming logical bottleneck. Henceforth, the 
logical bottleneck is exported at the boundary of the net- 
work, within the Terminating Equipment. 
The end result is that the bulk sent by the data link con- 
trol in the Terminating Equipment is paced so that the 
output matches that of the weakest point in the network, 
keeping it busy but not congested. 



FRTE 




Figure 1 : Frame Rdiy Network components 
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Description 

Field of invpntinn 

The present invention relates to high speed data 
networking and, more particularly, to the interconnec- 
tion for bandwidth allocation and control between Termi- 
nating Equipments (TE) and Frame Handlers (FH) in a 
Frame Relay (FR) switched network by adapting the 
committed information rate (CIR). 

Backorounri art 

The present invention makes references to the fol- 
lowing standards. 

- ANSI T1.617, T1.618 and T1.606 (addendum); and 

- ITU-T Q933 and Q922 
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destination FRTE. advising it to slow down the 
receipt of information. 

BECN : Backward ECN. Flows on the way back 
from which the congestion was experienced to the 
source FRTE of the traffic in order to pace it down 
Bottleneck : The node or the line in the network that 
limits the throughput over a PVC. Both the bottle- 
neck location and its throughput are subject to 
change overtime. 

LAN : Local Area Network, it interconnects station 
over a single plant (campus). Tendency is to go 
from the old shared media model to a switched 
model to have higher throughput. 
WAN : Wide Area Network, everything from the 
most common modem in a PC to a Serial Optical 
Network. It interconnects stations and LANs over 
long distance serial links. 



The terminology that is used throughout the 
description is as follows: 

FR : Frame Relay is dedicated to High speed 
switched networks. 

FH : Frame Handler concerns the function of FR 
layer 2 that handles frame switching in the network. 
TE : Terminating Equipment is a gateway from FR 
It handles upper layer 2 and layer 3 functions. 
Be : Committed Burst size is the number of bytes 
that can be sent in a burst according to Committed 
Information Rate. 

Be : Excess Burst size is the additional bytes to Be 
that may or may not be carried by the network. 
Tc : Period over which Be is sent, its value is gener- 
ally computed according to the formula 
CIR= Bc/Tc. 

CIR : Committed Information Rate which repre- 
sents a bit rate that is subscribed from a carrier 
V_CIR : Variable CIR which is the classical recom- 
mendation according to the standard organizations 
as mentioned above. 

A_CIR ; Adaptive CIR is the main object of this 
invention. 

ARB : Adaptive Rate Base represents the ability to 
perform flow control by adapting a transmission 
rate. 

PVC : Permanent virtual channel is a leased end to 
end path through the FR network. 
DLCI : Data Unk Control Identifier which identifies a 
PVC over a given hop. 

ECN : Explicit Congestion Notification where a bit is 
piggy-backed in FR Q922 header to notify of a con- 
gestion (which happens generally in the FH func- 
tion). The ECN uses the couple FECN/BECN of 
congestion management. 

FECN : Fonward ECN. Generally set by Frame Han- 
dler function in a frame that passes through a con- 
gested node and sends a signal to the receiving or 



Frame Relay technology has fairly succeeded over 
20 the last years into becoming the major multiprotocol (IP 
for intra/intemet, SNA, SNAP.. ) Wide Area Network 
(WAN) for interconnecting Local Area Networks (LAN) 
of a company's dispersed sites. 

Frame Relay is a switched multiplexed technology, 
25 Which means in other words that many end to end com- 
muriieations can share a given node or a given link with- 
out knowing each other. 

The load of that given node or link may thus change 
dramatically over time when huge data exchanges are 
30 asynchronously started. Preventing overuse of network 
resources is thus a major issue. Frame Relay uses 
Explicit Congestion Notifications to let FRTEs know 
about a congestion somewhere over a PVC path. The 
FRTE is responsible for diminishing its throughput till 
35 the congestion in the network terminates, through flow 
control operations. 

The definition of objectives and requirements for 
congestion management is provided in addendum 1 of 
ANSI T1.606. This Standard defines speed and bursti- 
w ness and describes how the network and the FRTE 
devices handle an overabundance of data traffic Con- 
gestion occurs when traffic arriving at a resource 
exceeds the networks capacity It can also occur for 
other reasons (equipment failure etc.). Network conges- 
"5 ton affects the throughput, delay, and frame loss expe- 
nenced by the FRTE. This latter should therefore 
reduce its offered load in the face of network conges- 
tion. ^ 

When links or nodes in the network are overused 
so logical bottlenecks fend to form and move throughout 
the network. A logical bottleneck becomes the place 
where most of the outstanding data get queued 
increasing latency and causing memory occupation 
where it is most unwanted and expensive. When net- 
55 work access speed increases, larger windows are 
needed and more multiplexing takes place. At some 
level, the bottleneck cannot keep up and starts discard- 
ing frames, which in turn reduces the traffic dramatically 
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The movement of data through a network some- 
times needs traffic signs to indicate when it should stop 
and go. Access signaling described in the ANSI T1 .61 7, 
CCITT Q.933, specifies a protocol for establishing and 
releasing switched frame relay virtual calls and provides 5 
a means to inform users of permanent virtual circuits of 
failure and restoration. 

Explicit Congestion Notifications (ECN) by the net- 
work are generally a reactive process intended to pro- 
tect the network nodes. Fonward ECN (FECN) and 10 
Backward ECN (BECN) are the most common conges- 
tion management signals. 

Adaptive Rate Based (ARB) protocols are the mod- 
ern solution to replace window based protocols. 
Whereas the window based protocols transfer a number 15 
of frames and then wait for an acknowledgement, the 
ARB protocols send a continuous binary flow at a given 
rate. 

Frame relay networks provide a Committed Infor- 
mation Rate (CIR) that is a kind of rate enforcement. 20 
refer to the ITU-T X36. but the CIR is still not adaptive. 
The CIR is the rate (expressed in bits per second) at 
which the data are transferred between the user equip- 
ment and the network. 

CIR standard provides a speed range between the 25 
committed and excess rates that the terminating equip- 
ment can use depending on whether the network 
reports a congestion or not. In order to adapt to the 
dynamics of transient logical bottlenecks, the Commit- 
ted Information Rate should be able to vary within that 30 
range. Any implementation that uses a static CIR is 
bound to be obsolete. 

Moreover, in the existing implementations, the ECN 
are used in the reactive way. meaning that the FECN 
and BECN are set when a congestion has already 35 
occurred. Should the occasion arises, the network 
enters a slow down condition to recover. In conse- 
quence, it Is not possible to obtain a fine tuning of the 
rate at the end point (FRTE). This is why the congestion 
notification should be issued as soon as the conditions 4o 
are reached that would lead to a congestion, but before 
it creates any damage. 

Existing implementations try to create a Variable 
CIR but : 

45 

There is no convergence in the algorithm, 
* A Terminating Equipment (TE) cannot achieve any 
rate tuning by itself. A cooperation between the 
switches (FRFHs) AND the end points (FRTEs) as 
a system is required to achieve a real rate tuning. so 

The problem addressed here is how to improve that 
current CIR technique in order to turn it into a rate con- 
trol and to optimize the throughput to the network to 
match the logical bottleneck capacity. 55 



Obiect of the invention 

The main object of the present invention is to 
improve the Committed Information Rate (CIR) function- 
ality in order to turn it into an Adaptive Rate Base (ARB) 
mechanism, so as to apply it to frame relay networks. 

The solution is based on the interaction between a 
proactive setting of the Explicit Congestion Notifications 
(ECN) in the Frame Handler (FH) function of the 
switches and a converging Adaptive CIR algorithm in 
the Terminal Equipments. 

The result of this interaction is that when a logical 
bottleneck is in the process of settling in a switch, the 
CIR at the Terminating Equipment adapts itself to the 
throughput of the forming logical bottleneck. Hence- 
forth, the logical bottleneck is exported at the boundary 
of the network, within the Terminating Equipment. 

The end result Is that the bulk sent by the data link 
control in the Terminating Equipment is paced so that 
the output matches that of the weakest point in the net- 
work, keeping it busy but not congested. 

Brief Descriotion of drawing g 

Figure 1 illustrates a block diagram of the compo- 
nents in the Frame relay network according to the 
present invention. 

Figure 2 compares the reaction of traditional Varia- 
ble CIR versus the Adaptive CIR according to the 
present invention, in case of dynamic variation of the 
available throughput for a P VC over time. 

Figure 3 provides the flow-chart explaining the 
FRTE dynamic CIR adjustment according to the present 
invention. 

Summary of the invention 

The Frame Relay Terminating Equipment (FRTE) 
and the Frame Relay Switching Equipment (FRSE, also 
called Frame Handler) must be considered as a system. 

Before reaching any kind of buffer, queue, or 
throughput limitation, the Frame Handler (FRSE) will 
decide whether it is in the process of becoming a logical 
bottleneck as soon as it: 

receives more data to transmit than it can actually 
send according to current Committed Information 
Rate over a short period of time; or 
introduces a given amount of delay on the traffic for 
a given Data Unk Control Identifier (DLCI). 

In both cases, the Frame Handler sets Fonward 
Explicit Congestion Notifications (FECN) on the traffic 
for that Data Link Control Identifier, which is echoed by 
the remote Frame Relay Terminating Equipment (FRTE) 
as a Backward Explicit Congestion Notification (BECN). 
The Frame Handler can also set BECNs, on the first 
opportunity in case the traffic flows in the other way 
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When the Frame Relay Terminating Equipment 
receives a BECN. it reduces its Committed Information 
Rate (CIR). If it does receive any BECNs. it increases 
the CIR. 

There are two important things that make the CIR 
adaptive and converging : 

The increment is dynamic, so that the Committed 
Information Rate settles dose to the optimum 
value. It starts with a minimum value and gets wider 
and wider until the CIR crosses the optimum value 
At that point, the CIR is set back to about the last 
value under the optimal point, and the increment 
becomes minimum again. When the CIR is dose to 
the optimum value; the increment should stay at the 
lowest value but its sign should diange all the time 
The rate is changed at a time base of at least the 
Turn Around Time (TAT) of the network, so that the 
effect of the previous tuning can be detected For 
instance, a fair value for the TAT is the retry timer of 
the Data Unk Control, if the TAT cannot be meas- 
ured dynamically. The time base may be much 
greater than the TAT in order to take account of the 
damping effect of the queues in the network if some 
switches do not implement proadive congestion 
detection. 



Detailed dssrriptinn the invant lpp 

Let us first discuss the rde of the switches in the 
system according to the present invention. It is very 
important that they deted an upcoming congestion 
before queues build up and delays are introduced in the 
traffic. 

A Frame Relay Switch (1 5) consists in pairs of part- 
ner Frame Handler subports (3.4) and (5.6) as shown in 
figure 1 Each partner corresponds to a given Data Unk 
Control Identifier referred as DLCI over a different phys- 
ical line, for instance the partner (3) corresponds to the 
DLC1 16 (9) over the physical link (12). The Frame Han- 
dler subports are assodated like a logical jumper 
between the DLCIs so that every frame received by a 
subport IS passed to its partner to be retransmitted A 
successive interconnection of switches (15) and Data 
Link Contrd Identifiers (10) creates an end to end Per- 
manent Virtual Channel. 

To be proactive in its congestion detection, a sub- 
port (3.4,5.6) measures the traffic received from its part- 
ner (I.e. 3 is the partner of 4) and enqueued in 
outstanding queue over the last Tc period. If the meas- 
ured traffic is greater than the cun-ent burst allowed by 
CIR. some of the frames for that DLCI will be stamped 
with FECNs. 

The number of ECNs set does not affect much the 
FRTE since most implementations integrate ECNs over 
time as a single information. Thus, instead of measuring 
the number of bytes queued, the variation of that infor- 
mation IS used as a primary congestion indicator. 



FECfMs are also set if the delay introduced queuing 
packets in the FH passes a predefined Threshold that 
depends on CIR value. 

Now that the FRFH sets ECNs in a proactive way 
5 the FRTE needs to use that information to send as 
much as the FH can handle - but not more -. The inven- 
tion allows the convergence of the CIR as illustrated in 
figure 2. 

Figure 2 shows a simulation of a change in the 
10 available throughput for a Permanent Virtual Channel 
(PVC). Variable CIR parameters are set to 12 percent 
increment and 25 percent deaement, which are com- 
mon defaults that exist in the marketplace. 

The throughput (20 1 ) shows that Adaptive Commit- 
'5 ted Information Rate (A-CIR) converges to a new value 
which can be very fast thanks to the exponential curve. 
As IS shown, the optimum curve is crossed faster than 
that of the Variable Committed Information Rate (V-CIR) 
shown in dots line. 
20 The throughput (202) illusfrates the damping of the 
Adaptive CIR around the optimum reached. 

The throughput (203) shows the existing of some 
'noise', I.e. certain irregularities are added on the opti- 
mum. In this part, the Adaptive CIR converges to the 
25 lowest level of that noise so that the network is never 
overused. 

Figure 3 details the algorithm used for adapting the 
CIR to the network capability the results of which are 
shown in figure 2. 
30 For this algorithm, several values are configured and act 
as constants: 



a minimum information rate (MIR) which is tiie min- 
imum value for Adaptive CIR; 
a Excess Information Rate (EIR) which is the maxi- 
mum value for Adaptive CIR; 
a PRECISION which determines how dose to the 
Frame Handler throughput tiie algorithm is 
expeded to converge and how fast it reaches the 
corred value (ranges 6 to 10). Value 7 is used in fiq- 
ure 2; and 

a TIME_BASE which specifies how often CIR is 
updated. Default is 3.2 seconds. 
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« Several variables are also defined for the algorithm; 

a CURRENT is the current value for the Committed 
Burst size (Be), which is the number of bytes that 
can be sent over a Tc period. This is what is to be 

so adjusted by referring to the network Explidt Con- 
gestion Notifications; 
* a DYN_INCREMENT is a variable that changes at 
each iteration by either being reset to zero or incre- 
mented by 1. The Maximum value for 

55 DYN_INCREMENT is 5; 

a DELTA is the amount by which CURRENT is 
incremented or decremented. DELTA is computed 
from CURRENT and DYNJNCREMENT 
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DELTA = CURRENT » (PRECISION - 

DYN_INCREMENT); 

where » is a binary shift right. 

In other words. DELTA is CURRENT divided by 2 at the s 
power of (PRECISION minus DYNJNCREMENT). 
DELTA Is at the minimum when DYNJNCREMENT is 
NULL and it is multiplied by 2 each time 
DYN_INCREMENT is incremented by 1 ; 

10 

* a BECN_RECEIVED is a flag that is raised when a 
frame with a BECN is received; 

* a JUST_REDUCED is a flag that is raised when 
CURRENT is decremented; it is reset when CUR- 
RENT is incremented to keep track of the last action is 
performed against CURRENT; and 

* a REQUEST_LARGER_CIR is a flag that is raised 
when the CURRENT value is not enough versus 
the traffic passed from the upper layer. 

20 

At INIT time, CURRENT Is set to the committed 
burst size (Be) and DYN_INCREMENT is set to 0. 

In RUN time, two processes operate in flip flop 
mode, being separated by half of TIME_BASE. 

25 

* Process 1 resets BECN_RECEIVED to sweep 
information that may not represent the latest 
change In CURRENT This is run at the first half 
TIME_BASE and then every TIME_BASE. This is 
actually optional but may Improve the algorithm so 
response in the case of high latency networks. 
Process 2, represented in figure 3, increments or 
decrements CURRENT based on whether 
BECN_RECEIVED is set or not. at step (301). If the 
current process does not modify the 35 
JUST_REDUCED flag, that means that we need to 
keep on changing the computed value of CIR In the 
same way (by incrementing or decrementing the 
CURRENT variable). DYNJNCREMENT is Incre- 
mented by 1 so that DELTA doubles and CURRENT 4o 
changes exponentially 

More in details figure 3 illustrates the method of CIR 
adaptation implemented in the Frame Relay Terminat- 
ing Equipment: 45 

At every TIME_BASE (300): 

If no BECN was received at step (301). the CUR- 
RENT (CIR) is lower than the end to end network capa- 
bility, so it will be increased In the process, unless more 
bandwidth is not needed. 50 

At step (302). if REQUEST_LARGER_CIR flag is 
not raised. CURRENT value Is left unchanged. The rea- 
son Is that CURRENT Is not currently used up so there 
Is no way to determine whether the network could sup- 
port as much as CURRENT Incrementing CURRENT is 55 
thus useless and dangerous too. 

At step (303) the REQUEST^LARGER^CIR flag is 
reset. 



At step (304). since no BECN was received and if 
JUST_REDUCED is raised, this means that we start 
incrementing CURRENT after having decremented it. 

At step (307). the JUST_REDUCED flag is reset 
since CURRENT Is in the process of being increased. 

At step (308) DYN_INCREMENT is reset to zero 
before DELTA is computed. (As a remark, this Is 
opposed to step (324) where DELTA is computed before 
DYNJNCREMENT is reset to zero. The reason is that 
the system is expected to leave CIR below the network 
capability, as much as possible. Therefore, increment- 
ing CURRENT is always in slow_start mode while dec- 
rementing starts by returning to the previous value, 
which was supposed to be under the optimal value for 
CURRENT, and then resetting DYNJNCREMENT). 

At steps (305) and (306), the DYNJNCREMENT is 
incremented if it does not reach the maximum value of 
5. Another value than 5 may used depending on the 
pace of convergence that is desired. 

At step (309). the computation of DELTA according 
to the formula mentioned above enables to increase the 
CURRENT value. 

At steps (310) and (311), the CURRENT value is 
tested so as to be limited by the maximum value for 
Adaptive CIR (EIR), Aftenwards. the algorithm loops 
back to step (300) where it waits for another time_base. 

Step (320) is not necessary If process 1 is run. It 
consists in resetting the BECN_RECEIVED flag. The 
process is now to reduce the CURRENT value of CIR. 

At steps (321), (322) and (323), the 
DYNJNCREMENT is incremented if it does not reach 
the maximum value of 5 and if the previous process was 
also to reduce the CURRENT value of CIR 
(JUST_REDUCED must be raised). 

At step (324). the conputation of DELTA according 
to the formula mentioned above enables to reduce the 
CURRENT value. 

At steps (325) and (326). if the previous process 
was not to reduce the CURRENT value of CIR 
(JUST_REDUCED must be reset). JUST_REDUCED is 
set and the DYN_INCREMENT is reset to zero. 

At steps (327) and (328). the CURRENT value is 
tested so as to be limited by the minimum value for 
Adaptive CIR (MIR), Afterwards, the algorithm loops 
back to step (300) where it waits for another tlme_base. 

The present invention directly applies to the internet 
as long as the IP traffic is carried over a frame relay 
backbone. The FRTE in the internet server will be able 
to pace its sending rate up to the optimal throughput the 
frame relay network can support. 

The invention Is not limited to this specific Imple- 
mentation. It can also apply to system composed of a 
data overflow sensor and an tunable source so as to 
optimize the amount of data emitted. 

For instance, an Internet server could limit Its trans- 
mit throughput up to the network capability to deliver the 
data to the end user, as opposed to sending bulks of 
data that load the network. This would require a sensor 
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of some kind placed in the boundaries of the internet in 
front of the low speed lines that serve most end users 
modems, m order to limit the congestion at that point. 

Another example can be a work load manager that 
shares tasks among a set of processors that are distrib- 5 
uted over a network. The manager issues orders to the 
processors at a given rate that is supposed to match a 
processor capability to execute these orders. If the proc- 
essor starts receiving more orders than it can achieve it 
W.B send a back pressure information to the manager w 
wittiin the response to an order. The manager will 
reduce the rate of orders sent to the processor that is 
overloaded. A processor that is shared between several 
managers has to slow down its execution rate for the 
current active managers when a new manager starts is 
using Its resources. 

Claims 

1. A method for tuning bandwidth in a data communi- so 
cation network between a plurality of terminating 
equipments (1,2,7.8) and a plurality of frame han- 
dlers (3.4.5.6) wherein each terminating equipment 
ts connected to a frame handler by a data link con- 
trol identifier (9,10. 11); 

said method being characterized in that anyone of 
said plurality of frame handlers (3,4,5,6) sets a 
Explicit Congestion Notification bit (ECN) in a 
proactive way so as to prevent overuse of network 
resource when: 
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■ anyone of said plurality of frame handlers 
(3.4,5,6) receives more data to transmit than it 
can send according to a adaptive Committed 
Information Rate (CIR); or 

- anyone of said plurality of frame handlers 
(3,4,5.6) introduces a delay on the correspond- 
ing data link control identifier in the network 
traffic. 

The method of tuning bandwidth as set in claim 1 
wherein anyone of said plurality of frame handlers 
(3,4,5.6) sets a first Explicit Congestion Notification 
bit (FECN) echoed by the corresponding terminat- 
ing equipment (1,2.7.8) as a second Explicit Con- 
gestion Notification bit (BECN). 

The method of tuning bandwidth as set in claim 2 
wherein in response to said first Explicit Congestion 
Notification bit, the terminating equipment (1 2 7 8) 
reduces its Committed Information Rate (CIR) 
instead of increasing it so as to make it adaptive to 
the network ti'affic. 

The method of tuning bandwidth as set in daim 3 
wherein the Committed Information Rate is 
increased step by step in slow_start mode or expo- 
nentially while it is reduced by returning to its previ- 
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ous value so as to make tiie adaptive Committed 
Information Rate converge to the optimal traffic 
level but which does not exceed the bottleneck 
throughput. 

5. The method of tuning bandwidth as set in claim 4 
wherein the pace of convergence is determined by 
a time_base and wherein the Committed Informa- 
tion Rate varies between a maximum and a mini- 
mum values to converge to an optimal value 
according to a predetermined precision. 

6. The method of tuning bandwidth as set in claims 5 
wherein ttie convergence of the Committed Infor- 
mation Rate is obtained by performing at every 
time_base the steps of. 

- testing (301) if an Explicit Congestion Notifica- 
tion has been received; 

- in case no Explicit Congestion Notification 
has been received; 

- if the Committed Information Rate is in 
the increasing mode, increasing 
(306.309) exponentially the amount of 
committed burst size by performing a 
binary shift right until it the Committed 
Information Rate exceeds ttie maxi- 
mum value so as to switch it in the 
decreasing mode; 

- if the Committed Information Rate has 
just ended its decreasing mode, 
increasing (308,309) slowly the 
amount of committed burst size; 

- in case an Explicit Congestion Notification 
has been received; 

- reducing (324) the amount of commit- 
ted burst size by returning to its previ- 
ous value if it has just increased; 

- reducing (323,324) exponentially ttie 
amount of committed burst size if the 
Committed Information Rate contin- 
ues its decreasing mode by starting 
from ttie minimum value of the Com- 
mitted Information Rate; and 

- looping back to first step for another time_base. 

The method of timing bandwidth as set in any one 
of the previous claims may be implemented in a 
frame relay switched network. 

The method of tuning bandwidth as set in any one 
of the previous daims may be implemented in an 
internet server. 
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The method of tuning bandwidth as set in any one 
of the previous claims may be implemented in a 
networked workload manager. 
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Figure 3: FRTE CIR Adjustement. 
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